Goto

Collaborating Authors

 computational principle


Volume Transmission Implements Context Factorization to Target Online Credit Assignment and Enable Compositional Generalization

Neural Information Processing Systems

The modern connectivist framing of neural computation emphasizes the primacy of synaptic communication at the risk of neglecting the influence of the surrounding neuromodulatory environment --- a neuron's'biophysical context.' Decades of experimental work has established two views of neuromodulatory (NMs) influence: 1) NMs significantly alter circuit dynamics and 2) NMs gate synaptic plasticity, acting as a'third factor' in learning. Here, we unify these perspectives, proposing that neuromodulation via volume transmission implements a powerful computational principle: context factorization. We derive an endogenously neuromodulated Recurrent Neural Network (e-nmRNN) from a rate reduction of NM release, showing how NM concentrations dynamically factorize network connectivity. This framework reveals how multiplicative NM gating distinctly influences dynamical regimes compared to additive input. Crucially, this context factorization enables targeted online credit assignment: learning rules derived for the e-nmRNN are naturally gated by NM concentrations, localizing updates to relevant contexts.


Technical Perspective: NeuroRadar: Can Radar Systems Be Reimagined Using Computational Principles?

Communications of the ACM

Interest in miniature radar systems has grown dramatically in recent years as they enable rich interaction and health monitoring in everyday settings. By 2025, industrial radar applications are anticipated to encompass 10 million devices, whereas the consumer market will reach a substantial 250 million. The applications are diverse--for example, Google's Pixel phones incorporated radar for gesture control, while small radar sensors are being deployed in homes to monitor elderly residents' movements and detect falls, offering more privacy than camera-based solutions. However, conventional radar architectures rely on complex RF front ends with power amplifiers, low-noise amplifiers, and phase-locked loops, collectively consuming hundreds of milliwatts of power. This makes radar sensing impractical for battery-powered or self-powered Internet of Things (IoT) devices and wearables.


Computational principles of intelligence: learning and reasoning with neural networks

#artificialintelligence

Despite significant achievements and current interest in machine learning and artificial intelligence, the quest for a theory of intelligence, allowing general and efficient problem solving, has done little progress. This work tries to contribute in this direction by proposing a novel framework of intelligence based on three principles. First, the generative and mirroring nature of learned representations of inputs. Second, a grounded, intrinsically motivated and iterative process for learning, problem solving and imagination. Together, those principles create a systems approach offering interpretability, continuous learning, common sense and more.


Computational principles of intelligence: learning and reasoning with neural networks

arXiv.org Artificial Intelligence

Despite significant achievements and current interest in machine learning and artificial intelligence, the quest for a theory of intelligence, allowing general and efficient problem solving, has done little progress. This work tries to contribute in this direction by proposing a novel framework of intelligence based on three principles. First, the generative and mirroring nature of learned representations of inputs. Second, a grounded, intrinsically motivated and iterative process for learning, problem solving and imagination. Third, an ad hoc tuning of the reasoning mechanism over causal compositional representations using inhibition rules. Together, those principles create a systems approach offering interpretability, continuous learning, common sense and more. This framework is being developed from the following perspectives: as a general problem solving method, as a human oriented tool and finally, as model of information processing in the brain.


Research Opens New Neural Network Model Pathway to Understanding the Brain

#artificialintelligence

WIRE)--NTT Research, Inc., a division of NTT (TYO:9432), today announced that a research scientist in its Physics & Informatics (PHI) Lab, Dr. Hidenori Tanaka, was the lead author on a technical paper that advances basic understanding of biological neural networks in the brain through artificial neural networks. Titled "From deep learning to mechanistic understanding in neuroscience: the structure of retinal prediction," the paper was presented at NeurIPS 2019, a leading machine-learning, artificial intelligence (AI) and computational neuroscience conference, and published in Advances in Neural Information Processing Systems 32 (NIPS 2019). Work on the paper originated at Stanford University, academic home of the paper's six authors when the research was performed. At the time, a post-doctoral fellow and visiting scholar at Stanford University, Dr. Tanaka joined NTT Research in December 2019. The underlying research aligns with the PHI Lab's mission to rethink the computer by drawing inspirations from computational principles of neural networks in the brain.


516

AI Magazine

Technical Program Registration The Fifth National Conference on Artificial Intelligence will be held 13-17 July 1987 in Seattle, Washington. AAAI-87's Technical Program will present outstanding research papers in AI. These papers will be divided into those emphasizing basic research and those emphasizing applied research. Basic research papers will stress the computational principles underlying cognition and perception in man and machine. Applied research papers will highlight pragmatic issues that arise in applying these computational principles.


Reducing Spike Train Variability: A Computational Theory Of Spike-Timing Dependent Plasticity

Neural Information Processing Systems

Experimental studies have observed synaptic potentiation when a presynaptic neuron fires shortly before a postsynaptic neuron, and synaptic depression when the presynaptic neuron fires shortly after. The dependence of synaptic modulation on the precise timing of the two action potentials is known as spike-timing dependent plasticity or STDP. We derive STDP from a simple computational principle: synapses adapt so as to minimize the postsynaptic neuron's variability to a given presynaptic input, causing the neuron's output to become more reliable in the face of noise. Using an entropy-minimization objective function and the biophysically realistic spike-response model of Gerstner (2001), we simulate neurophysiological experiments and obtain the characteristic STDP curve along with other phenomena including the reduction in synaptic plasticity as synaptic efficacy increases. We compare our account to other efforts to derive STDP from computational principles, and argue that our account provides the most comprehensive coverage of the phenomena. Thus, reliability of neural response in the face of noise may be a key goal of cortical adaptation.


Reducing Spike Train Variability: A Computational Theory Of Spike-Timing Dependent Plasticity

Neural Information Processing Systems

Experimental studies have observed synaptic potentiation when a presynaptic neuron fires shortly before a postsynaptic neuron, and synaptic depression when the presynaptic neuron fires shortly after. The dependence of synaptic modulation on the precise timing of the two action potentials is known as spike-timing dependent plasticity or STDP. We derive STDP from a simple computational principle: synapses adapt so as to minimize the postsynaptic neuron's variability to a given presynaptic input, causing the neuron's output to become more reliable in the face of noise. Using an entropy-minimization objective function and the biophysically realistic spike-response model of Gerstner (2001), we simulate neurophysiological experiments and obtain the characteristic STDP curve along with other phenomena including the reduction in synaptic plasticity as synaptic efficacy increases. We compare our account to other efforts to derive STDP from computational principles, and argue that our account provides the most comprehensive coverage of the phenomena. Thus, reliability of neural response in the face of noise may be a key goal of cortical adaptation.


Reducing Spike Train Variability: A Computational Theory Of Spike-Timing Dependent Plasticity

Neural Information Processing Systems

Experimental studies have observed synaptic potentiation when a presynaptic neuron fires shortly before a postsynaptic neuron, and synaptic depression when the presynaptic neuron fires shortly after. Thedependence of synaptic modulation on the precise timing of the two action potentials is known as spike-timing dependent plasticityor STDP. We derive STDP from a simple computational principle:synapses adapt so as to minimize the postsynaptic neuron's variability to a given presynaptic input, causing the neuron's output to become more reliable in the face of noise. Using an entropy-minimization objective function and the biophysically realisticspike-response model of Gerstner (2001), we simulate neurophysiological experiments and obtain the characteristic STDP curve along with other phenomena including the reduction in synaptic plasticity as synaptic efficacy increases. We compare our account to other efforts to derive STDP from computational principles, andargue that our account provides the most comprehensive coverage of the phenomena. Thus, reliability of neural response in the face of noise may be a key goal of cortical adaptation.